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ABSTRACT 

Instructional gaming, as distinguished from 
simulation, is defined as any overt instructional or learning format 
that involves competition and is rule-guided. The literature review 
identifies five categories of articles on instructional gaming: (1) 
research, (2) theory, (3) reviews, (4) discussion, and (5) 
development. Games have been found to serve many functions, such as 
tutoring, amusing, helping to explore new skills, promoting 
self-esteem, practicing skills, or seeking to change attitudes. Some 
assertions drawn from the literature that might be useful in using or 
designing a game or in researching its use or design are presented. A 
chart presents an annotated bibliography of 94 articles related to 
gaming. (SLD) 
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Few would argue these days of the potential instructional gaming has for enriching 
certain educational and training activities. For instance, Faria (1987) has reported that 
4 600 of the-larger U.S. firms he surveyed by mail or telephone, use business or 
experiential games in training or development. Those who profess the educational benefits 
• of gaming have been encouraged to some extent by a number of researchers who have 
found a wide range of benefits which, for example, include improved practical reasoning 
skills (Wood and' Stewart, 1987), higher levels of continuing motivation (Malouf 1988), 
and reduced training time and instructor load (Allen, Chatelier, Clark, & Sorenson, 1982). 
Some researchers, however, have questioned certain of these claims due to a lack of 
sufficient empirical support (e.g., Bredemeier & Greenblat, 1981). Even so, very diverse 
training applications, such as attention reduction or automaticity raining (Jacobs, 
Dempsey, & Salisbury, 1990) and complex problem solving (Hayes, 1981), are 
hypothesized to be prime candidates for gaming strategies. 

The purpose of this paper is to report on our continuing review of five categories ot 
gaming articles in order to present some implications and, in some cases, guidelines to 
designers and educators. We see this review as part of the search for the beneficial uses of 
gaming in the learning processes, particularly as applied to computer-driven media and 
multimedia. 

What is gaming anyway? 

Gaming is defined as being separate from simulation and is defined, in a basic 
sense as any overt instructional or learning format that involves competition and is rule- 
guided (Dempsey, Lucassen, Gilley, & Rasmussen, 1993-94). A competitive format, as 
we see it, does not necessarily require two or more participants. If a simulation, for 
instance, produces an overall "score," then it is possible for a learner to compete against 
herself by comparing scores over successive attempts at the simulation. Therefore, this 
learner mav be in a gaming mode. If, however, the focus of the simulation involves the 
completion of an event onlv (e.g., navigating a channel in a boat), then according to our 
definition the simulation would not be considered a game. A game structure may be 
imposed on the simulation from outside, however. For example, in the boating scenario, 
learners could compete by seeing how many safe passages they could achieve in a certain 
amount of time compared with another person or their own prior performance. Gaming 
elements offer particular characteristics which may be manipulated within the simulation 
training context, and thus can be treated separately. 

Categories of the articles in the Gaming Literature 

Our review of the literature to this date consists of 91 sources, most of which are 
journal articles. We located these using ERIC, PSYCHL1T, MEDLINE, and reference 
citations from other articles. With few exceptions, we concentrated our review on articles 



published in the last 12 years. We oriented (but did not limit) our search to articles 
concerning instructional games which used some form of technology and were substantive 
in nature. We felt that our first step in looking at the literature consisted of establishing a 
typology by which gaming articles could be categorized for study. After some 
consideration, we defined the following five categories of gaming articles. These 
definitions were employed in an earlier related article (Dempsey, Lucassen, Gilley, & 
Rasmussen, 1993-94). 

Research : any systematic approach used in the study of gaming whose goal is to 

explain, predict or control a particular phenomena or variable. 

Research studies may be further broken down into their paradigms 

(e.g., case study, experimental study). 
Theory . articles which offer to explain the basic concept of gaming or aspects of 

gaming or the outcomes derived. 
Reviews : synthesis of articles concerning gaming in general or a specific aspect of 

gaming. 

Discussion : articles which state or describe experiences or opinions with no 

empirical or systematically presented evidence. 
Development : articles which discuss projects involving gaming or the design or 

development of instructional games. 

To date, we have reviewed more discussion articles (n=43) than the nearest 
category, research (n=33). Although we have only unsystematically sampled a small 
portion of the literature thus far, we expect the trend in the gaming literature to continue to 
be dominated by discussion articles. Nine literature review and seven primarily theoretical 
articles were located. Early on, we were mildly surprised at the low number of 
development articles (n=4) we have located. 

Types of Games 

One of our efforts has been to delineate and eventually work toward operational 
definitions of types of instructional games. In this and our prior review, we separated 
oames into simulations, puzzles, adventures, experimental games, motivational games, 
modeling, and others (e.g., frame games). To be candid, we are likely to change the types 
of games delineations we have chosen in future explorations of gaming. At any rate, 
simulation sames accounted for the largest number of articles we encountered in this review 
(n=42). The "other" category was second (n=20), followed by adventure (n= 10), puzzles 
(n=4), and experimental and motivation (n=l each). 

This abundance of articles concerning simulation games may, in part be the result of 
technological improvements and the long and well-documented history of simulation 
gaming in education, particularly in the military and in business education. Also, simulation 
gaming parallels current movements in instructional technology such as situated cognition 
and anchored instruction which hold that knowledge is inseparable from its context. 
Theorists in these areas (e.g., Brown, Collins, & Duguid, 1989; Perelman, 1992) support 
the notion that the human brain is designed to learn through experience and experience has 
no meaning except in some context. Simulation games can provide that experience in the 
absence of real life experience. Thus, simulation games are a powerful tool whose use can 
only be expected to increase. 

Learning Outcomes 

As our literature review focus on instructional or educational gaming, we were 
interested in what learning outcomes were discussed. In a large number of articles 
concerning games or gaming (n=37), specific learning outcomes were ignored or a 



discussion of learning outcomes per se was not germane. The largest specific learning 
outcome discussed in those articles that did so, however, was problem-solving (n=21). As 
the reader can see in Figure 1, the articles we reviewed covered most of the nine domains 
and sub-domains of learning in Gagne's taxonomy (Gagne, 1985), suggesting that 
technology-based instructional gaming has a wide spectrum of utility for learning We were 
particularly interested in the preponderance of games intending to promote higher-level 
intellectual skills and attitude learning as opposed to verbal knowledge outcomes. We see 
this as a positive testimonial to the gaming mode. 



Fig. 1. Learning Outcomes 



Learning Outcomes 




Function of Games 

Games serve many functions such as tutoring, amusing, helping to explore new 
skills promoting self-esteem, practicing existing skills, drilling existing skills, 
automatizing, or seeking to change an attitude. In the articles we reviewed, the functions ot 
the instructional games were moderately well-distributed, but suggested that games were 
not frequently employed to serve as a tutor. As Figure 2 illustrates practicing existing skills 
(n=22) was the highest frequency and learning new skills (n=21) was a close second. 
Many of the articles stated that games were used to learn new skills after some introductory 
instructional events had prepared the learner for the competitive instructional interaction. 
The variety of functions discussed in the gaming literature we reviewed is seen as a positive 
indicator paralleling the agreeable diversity of learning outcomes with which gaming may 
be used. 
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Fig. 2. Functions of Games 

Function of Games 




Gaming environment 

There are great environmental differences assumed by the designers of instructional 
games. We reviewed articles from the following environments: elementary education, 
secondary education, adult education, business, management, military, health care. The 
largest number of journal articles considered gaming in the context of adult education 
(n=25). We came upon no claims in our reading that instructional gaming was more 
effective in one environment compared to any other. 



Media 

Clearly, there are more media options available today than there were a decade ago. 
How has this affected gaming? Many of the articles we reviewed that used technology 
employed the computer only (n=32). A reasonable number of articles employed a 
combination of media (e.g., the computer and interaction with a live instructor). Other 
media employed were video-related media (i.e., video tape and optical videodisc). Role- 
playing was common regardless of the media. 



Measurement 



Key issues in gaming research are the appropriateness, validity, and reliability of 
the measured outcomes. Several authors (e.g., Reiser & Gerlach, 1977; Reuben & 
Lederman, 1982) have chided the lack of appropriate dependent variables and the lack of 
clarity of their terminology. Expanding slightly on the work of Bredemeier & Greenblat, 
1981, dependent variables of integrity in this literature include creativity, problem-solving 
ability, achievement, retention, attitude, self-image, self-efficacy, and continued 
motivation. 

The variable mentioned most often in our review of the literature was achievement 
(n=33). This was mentioned almost twice as much as the next most frequent, problem- 
solving (n=l3). Other measurement variables included attitude and continued motivation 
(n=l() each), and retention (n=7), . 
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Learner Characteristics 

The various characteristics of the learners participating in gaming fences were 
of increasing interest to authors in the gaming literature during the dozen years. Our review 
SSrS? pSS,naHty variables, cognitive style variables gaming and academic ability 
^1 i !2 „,E Tcpv race and age) We found that authors we reviewed were, for the 
and ,fnTn lew unc ear" in Soirin?these characteristics. Of the articles we reviewed, sex 
wa ffi«l2Sfy^3S (n=l 1), age was second (9), academic ability and race 

™*eH even less fn=5 and n=3 respectively). Characterises we expected to be 
^00^ such aTpe rs I ahty traUs or cognitive st/les were reported only twice. Although 
mSSattention was given in the articles we reviewed to discussion of the learner , few 
articles considered variables related to learner characteristics. 

Implications 

d , ctn*»H <nme assertions that grew out of the articles that we reviewed that might 

After each assertion, at least one article 
is d ed which made or in our opinion supports in some way, the listed assertion 
N^mhdesV aT presented below, the assertions are very open to deliberation. Although 
to some cros overstatements (e.g., regarding sex differences), an attempt has been 
made to separate assertions which may be practicable in using or designing a game for 
SSSSSf^SSa and a separate section for conducting research related to gaming as a 
learning activity. 

Using or Designing the Game 

It is preferable in many cases, although usually more difficult, to use a gaming ^vehicle 
which" intrinsically motivating as opposed to an extnnsica ly novating game In an 
EsfcX motivating gaming activity, the game structure itself helps to teach the 
national content. In an extrinsically motivating game, external rewards (real or 
imaginary) of some sort are usually given. (Deci, 1972; ; Malone. 1981). 

In considering which game to emplov in a learning activity, pay special attention to gender 
orefe ences TheJe appears to be some disparity in the types of gan™ and the types jof 
SnTactivities preferred by males and females (Braun. Goupil, & Giroux 1986, Malone. 

i98Dr 

When possible, employ debriefing as an a part of or in addition to gaming activities. 
(Carrol, 1986). 

Change the methods of scoring in a game to channel attention and vary the level of 
challenge (Allen, Jackson, Ross, & White, 1978). 

r,Mmin" used for instructional purposes should not be overly complex. Complex rules and 
SSgWre learner to use up limited learning time in order to understand the game 
(Jacobs, & Dempsey, 1993). 

rivmae the levels of complexity or difficulty based on the learner's experience with the 
S2g structure This will help promote interest in instructional materials as the learner s 
gaming abilities increase (Jacobs. & Dempsey, 1993). 

When developing or adapting games for instructional £^^^^^ l Jjffi ning 
strategies which can be used for your particular purposes (Dnskell & Dwyer. IVX4). 
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If the learning activity is construed to be less than exciting to the learning population, 
consider using adventure games or other games which have a strong challenge component 
and add an uncertain outcome to the fantasy of the game (Grabe & Dosmann, ^88). 

For issues of conflict or control, use or adapt games which employ both role-playing and 
fantasy. The role playing requires the student to play an active part. The fantasy allows the 
student to make serious errors with minimum detriment (Kowitz & Smith, 1989). 

Intrinsically motivating strategies for use in an educational gaming environment may be 
discovered by interviewing or observing very effective learners in a particular content area 
(Logan, Olson, & Lindsey, 1989, Oxford & Crookall, 1988). 

If vour goal is to change the learner's attitude, simulation gaming, if designed with a theory 
base in mind, has been shown to be an effective vehicle (Renaud & Stolovitch, 1988: 
Williams, 1980). 

Use a highly visual simulation game which includes all participants to help understand, 
address, and resolve group decision-making (Hasell, 1987). 

Make sure your game has a way of ending so the satisfaction of the learner may be 
maximized (Reuben & Lederman, 1982). 

Researching the Game 

Identify the direct and indirect aims of the game (Barnett, 1984). 

Avoid the apples and oranges comparison studies between games and traditional teaching 
techniques. (Barnett, 1984; Fraas, 1982; Megarry, 1977). 

Much of the research involving gaming should involve variables relating to motivation 
(Malone, 1981). The use of motivational scales such as Keller's Instructional Materials 
Sca'o should be adopted, adapted, and validated. (Klein & Frietag, 1991). 

Consider the effect of being on a losing team or in losing roles? For example, how are self- 
esteem and attitudes toward the winners affected (Greenblat, 1980)? In addition, how do 
these change when one of the teams or players is a computer? 

Allowing learners to "wager" tokens or imagined currency in an instructional gaming 
environment holds some promise for representing some aspects of learner certitude and 
therefore internal processes of expectancy. There is some a possibility of unwanted 
intervening variables, particularly those related to gambling (Griffiths, 1990; 1992). 

As gaming becomes a more important area for exploration, there will be an increasing need 
to develop worthwhile measures of strategy (Laughery, 1984). 

Regardless of the findings of some researchers that arcade-style gaming is a social and not 
an achievement oriented activity (McClure & Mears, 1986), this activity is increasing 
greatly as a result of more sophisticated and lower priced hardware and software in 
personal computers. Educational researchers will be more frequently asked how this typ 
of gaming activity can be incorporated into learning environments. 

Much of what takes place on a gaming environment may not be easily measurable or, at 
least easily reduced to a few variables. Therefore, although experimental studies have an 
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important place in the instructional gaming literature, it is critical that researchers honestly 
recognize the limitations of objective-oriented research for assessment and also look at the 
effects of incidental learning. (Barnett, 1984; Remus, 1981). 

The validity of the assessment of an instructional game is somewhat different than with 
other learning environments and, according to Reuben & Lederman (1982) is dependent on 
rules, interactions, roles, goals, & criteria. 

Girls are often thought to be not as competitive as boys in a gaming environment. To some 
extent that is situational or a result of a less socially reinforcing scenario (Hughes, 1988). 

Increased involvement (being in control of the program) has been found to increase 
learning with a simulation game (Wishart, 1990). 

Four clusters of factors which influence the effects of a simulation game include 
administrative variables (characteristics of "who runs the game"), learner variables (e.g., 
ethnicity or learning style), procedural variables (such as postgame discussion), and game 
variables (e.g., depicting reality). (Williams, 1980). 

Bibliography 

Something we thought might be useful to designers and researchers interested in 
educational gaming was a fairly recent reference list with the category of article, the 
statistical analysis used for those articles involving quantitative research, the environment 
for which the instructional gaming is intended, and an additional comment describing the 
article or its purposes. A table with this information follows. 
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